Electronic Version 
Stylesheet Version vl.1.1 

Description 

METHOD AND APPARATUS FOR 
REMOVING BLOCKING ARTIFACTS OF 
VIDEO PICTURE VIA LOOP FILTERING 
USING PERCEPTUAL THRESHOLDS 

Background of Invention 
[000 1 ] 1. Field of the Invention 

[0002] The present invention relates to a method and an appara- 
tus for removing blocking artifact of a video picture, and 
more particularly, to a method and an apparatus for re- 
moving blocking artifacts of a video picture via loop filter- 
ing using perceptual thresholds. 

[0003] 2. Description of the Prior Art 

[0004] Currently, as defined in most video encoding specifica- 
tions, pixel data of a video picture is usually encoded in 
units of blocks (e.g. each block including 4 by 4 pixels). A 
quantization operation of each block is required for in- 
creasing the compression rate of the pixel data. As a re- 



suit, after being decoded, the block-based video picture 
has blocking artifacts, which are discontinuity effects 
around boundaries between the blocks. In order to de- 
crease the severity of the blocking artifacts to improve the 
quality of the block-based video picture, the H.264 speci- 
fication, which is a newly introduced video encoding spec- 
ification, utilizes loop filtering for processing the blocking 
artifacts. Please refer to the H.264 specification for more 
information. 

[0005] when implementing, a loop filter is installed within an en- 
coding loop or a decoding loop of a video processing sys- 
tem to perform the above-mentioned loop filtering. The 
processing efficiency of the loop filter is better than that 
of a post filter installed outside an encoding loop or a de- 
coding loop. In addition, it is unnecessary to install a 
buffer for the loop filter as required for the post filter. 
Fig.l illustrates a combination of video processing sys- 
tems 110 and 130 including loop filters, respectively, and 
a transmission/storage media 120. The video processing 
system 110 is an encoding loop 110 for encoding video 
data inputted from an input end 111. The transmission/stor- 
age media 120 is used for transmitting or storing encoded 
video data generated by the encoding loop 110. The video 



processing system 130 is a decoding loop 130 for decod- 
ing the encoded video data inputted from the transmis- 
sion/storage media 120 and outputting decoded video 
data at an output end 133. Please note, the transmission/stor- 
age media 120 can be a transmission channel such as the 
internet. In addition, the transmission/storage media 120 
can be a storage device such as a CD drive or a DVD drive. 
[0006] The encoding loop 110 includes an encoding unit 112, a 
reconstruction unit 114, and a loop filter 116. The decod- 
ing loop 130 includes a decoding unit 132 and a loop fil- 
ter 136. As needed for video processing complying with 
the MPEG specification, data of predictive frames (P 
frames) including partial video information should be 
compared with data of intra frames (I frames) including 
full video information by the encoding loop 110 so that 
the P frames can be encoded. The loop filter 116 performs 
the loop filtering while the encoding loop 110 performs 
the encoding. As a result, the processing efficiency of the 
loop filter 116 is better than that of the post filter. Simi- 
larly, data of the P frames should be compared with data 
of the I frames by the decoding loop 130 so that the P 
frames can be decoded. In this case, the loop filter 136 
performs the loop filtering while the decoding loop 130 



performs the decoding. As a result, the processing effi- 
ciency of the loop filter 136 is better than that of the post 
filter. 

[0007] Although the H.264 specification has the advantage of the 
loop filtering instead of post filtering, complexity of loop 
filtering calculations becomes a bottleneck for processing 
speed. For example, within a decoder complying with the 
H.264 specification, the loading of a loop filter for remov- 
ing blocking artifacts is 33% of the total loading of the de- 
coder. 
Summary of Invention 

[0008] it is therefore an objective of the present invention to pro- 
vide a method and an apparatus for removing blocking 
artifacts of a video picture via loop filtering using percep- 
tual thresholds to solve the above-mentioned problem. 

[0009] The present invention provides a video processing method 
for processing blocking artifacts between two blocks 
within a video picture. The video processing method in- 
cludes: storing pixel values corresponding to the two 
blocks; and comparing two boundary edge pixels adjacent 
to a boundary between the two blocks according to a first 
threshold to determine if the pixel values of the two 
boundary edge pixels should be adjusted, if a difference 



corresponding to the pixel values of the two boundary 
edge pixels complies with the first threshold, adjusting 
the pixel values of the two boundary edge pixels to de- 
crease the difference. 

[0010] Accordingly, the present invention further provides a loop 
filter of a video processing system for processing blocking 
artifacts between two blocks within a video picture. The 
loop filter includes: a storage unit for storing pixel values 
corresponding to the two blocks; a comparison unit elec- 
trically connected to the storage unit for comparing two 
boundary edge pixels adjacent to a boundary between the 
two blocks according to a first threshold to determine if 
the pixel values of the two boundary edge pixels should 
be adjusted, if a difference corresponding to the pixel val- 
ues of the two boundary edge pixels complies with the 
first threshold, the comparison unit determining that the 
pixel values of the two boundary edge pixels should be 
adjusted to decrease the difference; and an arithmetic unit 
electrically connected to the comparison unit and the 
storage unit for adjusting the pixel values of the two 
boundary edge pixels. 

[° 01 1 ] It is an advantage of the present invention that the 

present invention method and device process the blocking 



artifacts of the video picture by loop filtering so that the 
present invention method and device have better process- 
ing efficiency in contrast to post filtering methods and 
devices. 

[0012] | t j S another advantage of the present invention that the 
present invention method and device use perceptual 
thresholds to determine if the pixel values of the two 
boundary edge pixels should be adjusted so that a fast 
determination for ignoring blocking artifacts that are not 
easy to identify by the human eye is available. As a result, 
the early termination of processing according to the fast 
determination enhances the processing efficiency of the 
video picture. 

[0013] These and other objectives of the present invention will no 
doubt become obvious to those of ordinary skill in the art 
after reading the following detailed description of the pre- 
ferred embodiment that is illustrated in the various fig- 
ures and drawings. 
Brief Description of Drawings 

[0014] pig.l is a block diagram of a combination of video pro- 
cessing systems and a transmission/storage media ac- 
cording to the prior art. 

[0015] pig. 2 is a flowchart of a video processing method accord- 



ing to the present invention. 

[0016] pig. 3 is a flowchart of the intra filtering process of the 
video processing method shown in Fig. 2. 

[0017] pig. 4 is a flowchart of the inter filtering process of the 
video processing method shown in Fig. 2. 

[0018] Fig. 5 is a diagram of related blocks processed by the 
video processing method shown in Fig. 2. 

[0019] Fig. 6 is a pixel sequence diagram with the pixels pro- 
cessed by the video processing method shown in Fig. 2. 

[0020] Fig. 7 is a diagram of the pixel values processed by the 
video processing method shown in Fig. 2. 

[0021] Fig. 8 is a lookup table of the boundary strength used in 
the inter filtering process shown in Fig. 4. 

[0022] Fig. 9 is a block diagram of a perceptual loop filter accord- 
ing to the present invention. 

[0023] Fig. 10 is a block diagram of a video encoder utilizing the 
perceptual loop filter shown in Fig. 9. 

[0024] Fig. 11 is a block diagram of a video decoder utilizing the 

perceptual loop filter shown in Fig. 9. 
Detailed Description 

[0025] please refer to Figs. 2-4. Fig. 2 illustrates a flowchart of a 
video processing method according to the present inven- 
tion. Figs. 3 and 4 respectively illustrate steps 201a and 



201b shown in Fig. 2 in detail. At first, step 200 of the 
present invention method determines the frame type, 
wherein step 200 is well known in the art. When a frame 
needing to be processed is an intra frame, step 201a will 
be executed; else, the frame needing to be processed is 
an inter frame and step 201b will be executed. The 
above-mentioned intra frame includes: intra slice and 
synchronized intra slice (SI slice). The above-mentioned 
inter frame includes: predicted slice (P slice), bidirectional 
predicted slice (B slice), and synchronized predicted slice 
(SP slice). As the content of step 201b is similar to a por- 
tion of the content of step 201a, descriptions of step 
201b will come after descriptions of step 201a. 
[0026] please refer to Figs. 3-6. Fig. 5 is a diagram of related 

blocks processed by the video processing method shown 
in Fig. 2. Fig. 6 is a pixel sequence diagram with the pixels 
processed by the video processing method shown in Fig. 2. 
In the present embodiment, video pictures processed by 
the method shown in Fig. 3 and Fig. 4 consist of mac- 
roblocks 300 shown in Fig. 5. Each macroblock 300 in- 
cludes sixteen blocks 315, 316, , 348, wherein each 

block includes 4 by 4 luminance pixel values or 2 by 2 
chromatic pixel values. The vertical axis in Fig. 6 denotes 



the magnitude of the pixel values, and the horizontal axis 
in Fig. 6 denotes a normal vector n, wherein the normal 
vector n is perpendicular to a boundary 401 between two 
adjacent blocks P and Q (not shown) within the video pic- 
ture. 

[0027] The pixel values p. and q. (i = 0, 1, ) shown in Figs. 3, 

4, and 6 correspond to the two adjacent blocks P and Q, 
wherein the pixel values p Q and q Q denote the pixel values 
of two boundary edge pixels closest to the boundary 401 
between the two blocks P and Q and arranged along the 
normal vector n. The pixel values p i and q i denote the 
pixel values of two interior edge pixels less close to the 
boundary 401 and arranged along the normal vector n, 
and so on. For example, assuming that the blocks 326 
and 336 shown in Fig. 5 are the two adjacent blocks P and 
Q, respectively, and the normal vector m shown in Fig. 5 is 
one of all the normal vectors perpendicular to the bound- 
ary 303, then the boundary 401 shown in Fig. 6 is the 
boundary 303 shown in Fig. 5 and the normal vector n 
shown in Fig. 6 is the normal vector m shown in Fig. 5. In 

this situation, the pixel values p Q , p , shown in Fig. 6 

denote the pixel values of the pixels sequentially arranged 
away from the boundary 303 and along the normal vector 



m while the first pixel value p Q corresponds to the pixel 
closest to the boundary 303 and within the block 326. 
Similarly, the pixel values q Q , q , shown in Fig. 6 de- 
note the pixel values of the pixels sequentially arranged 
away from the boundary 303 and along the normal vector 
m while the first pixel value q Q corresponds to the pixel 
closest to the boundary 303 and within the block 336. As 
the choice of the normal vector m changes, the blocking 

artifacts on boundaries 301, 302, , 308 of each blocks 

315, 316, , 348 of each macroblock 300 within the 

video picture are processed by the video processing 
method shown in Figs. 3 and 4, and all the blocking arti- 
facts are removed. 

[0028] As illustrated in Fig. 3, the present invention provides the 
video processing method for processing the blocking arti- 
facts between the two blocks P and Q within the video 
picture. The video processing method is a loop filtering 
method of a video encoding process or a video decoding 
process. The order of the following steps is not a limita- 
tion of the present invention. Step 201a of the video pro- 
cessing method is described in detail as follows. 

[0029] step 202:Store the pixel values p and q (i = 0, 1, and 2) 

i i 

corresponding to the two blocks P and Q. 



[0030] step 204:Compare the pixel values p Q and q Q of the two 
boundary edge pixels adjacent to the boundary 401 be- 
tween the two blocks P and Q according to a noticeable 
difference threshold Al to determine if the pixel values p Q 
and q o of the two boundary edge pixels should be ad- 
justed. If a difference lp Q - q Q l between the pixel values p Q 
and q Q of the two boundary edge pixels is less than the 
noticeable difference threshold Al, enter the Early Termi- 
nation state 290 to save time for further processing of 
other pixel values; else, proceed to step 206. The notice- 
able difference threshold Al is referred to as the just no- 
ticeable difference (JND) Al. 

[0031] step 206:Compare the pixel values p Q and q Q of the two 
boundary edge pixels adjacent to the boundary 401 be- 
tween the two blocks P and Q according to a recognizable 
discontinuity threshold T(AQ, Al) to determine if the pixel 
values p Q and q Q of the two boundary edge pixels should 
be adjusted. If the difference lp Q - q Q l between the pixel 
values p Q and q Q of the two boundary edge pixels is less 
than the recognizable discontinuity threshold T(AQ, Al), 
proceed to step 208; else, enter the Early Termination 
state 290 to save time for further processing of other 
pixel values. Wherein the recognizable discontinuity 



threshold T(AQ, Al) is referred to as the recognizable dis- 
continuity limit T(AQ, Al). 
[0032] step 208:Compare the pixel value p Q or q Q corresponding 
to one pixel out of the two boundary edge pixels with the 
pixel value p i or q i corresponding to the interior edge 
pixel adjacent to the one pixel according to an adjustment 
threshold A/2 to determine if the pixel values p and q 
of the two boundary edge pixels should be adjusted. If ei- 
ther a difference lp i ~ p Q l between the pixel values p i and 

p of the block P is less than the adjustment threshold A/ 
K o J o 

2 or a difference Iq^ q Q l between the pixel values q i and 

q of the block Q is less than the adjustment threshold A/ 
M o J o 

2, proceed to step 210; else, enter the Early Termination 
state 290 to save time for further processing of other 
pixel values. 

[0033] step 2 10:Adjust the pixel values p Q and q Q of the two 

boundary edge pixels to decrease the difference lp Q - q Q l 
between the pixel values p Q and q Q of the two boundary 
edge pixels. Wherein, the difference lp Q - q Q l is a lumi- 
nance difference or a chromatic difference. The adjust- 
ment results of this step are listed as follows: 

[0034] n ' = n + kA 
^0 ^0 0 

[0035] q ' = q - kA 

M 0 M 0 0 



[0036] anc | a fter the adjustment of this step, execute steps 212p 
and 212q respectively. 

[0037] step 212p:Compare an adjusted pixel value p Q ' of an ad- 
justed pixel out of the two boundary edge pixels with the 
pixel value p i of the interior edge pixel adjacent to the 
adjusted pixel according to the noticeable difference 
threshold Al to determine if the pixel value p i of the inte- 
rior edge pixel should be adjusted. If a difference lp i - p 
'I between the pixel values p and p ' is less than the no- 
ticeable difference threshold Al, enter the Early Termina- 
tion state 291p to save time for further processing of 
other pixel values; else, proceed to step 214p. 

[0038] step 214p:Calculate a predictive adjustment value p ' of 
the interior edge pixel adjacent to the adjusted boundary 
edge pixel as the following: 

[0039] p ' = p + o.5kA 

[0040] and compare the pixel value p i of the interior edge pixel 
with the predictive adjustment value p ' to determine 
which of the values p i or p 1 is closer to an average p 
,and to determine if the pixel value p of the interior 

m 1 

edge pixel should be adjusted. As illustrated in Fig. 7, the 
average p is the midpoint between the pixel values p ' 

m 0 

and p .If a difference Ip '- p I between the values p ' and 

2 1 m 1 



p is less than a difference Ip - p I between the values p 

m 1 m 1 

and p , proceed to step 216p; else, the pixel value p will 

m 1 

not be adjusted. 

[0041] step 216p:Adjust the pixel value p i of the interior edge 

pixel to be the predictive adjustment value p ' thereof (i.e. 
p ' = p + 0.5kA ). 

[0042] step 212q:Compare an adjusted pixel value q Q ' of an ad- 
justed pixel out of the two boundary edge pixels with the 
pixel value q i of the interior edge pixel adjacent to the 
adjusted pixel according to the noticeable difference 
threshold Al to determine if the pixel value q i of the inte- 
rior edge pixel should be adjusted. If a difference lq i - q 
'I between the pixel values q and q ' is less than the no- 
ticeable difference threshold Al, enter the Early Termina- 
tion state 291q to save time for further processing of 
other pixel values; else, proceed to step 214q. 

[0043] step 214q:Calculate a predictive adjustment value q ' of 
the interior edge pixel adjacent to the adjusted boundary 
edge pixel as the following: 

[0044] q ' = q _ o.5kA 

[0045] anc | compare the pixel value q i of the interior edge pixel 
with the predictive adjustment value q ' to determine 
which of the values q or q ' is closer to an average q of 

11 m 



the adjusted pixel value q Q ' of the adjusted boundary 
edge pixel, and to determine if the pixel value q i of the 
interior edge pixel should be adjusted. As illustrated in 
Fig. 7, the average q is the midpoint between the pixel 

m 

values q ' and q . If a difference Iq '- q I between the 
values q ' and q is less than a difference Iq - q I be- 
tween the values q and q , proceed to step 216q; else, 

1 m 

the pixel value q i will not be adjusted. 

[0046] step 216q:Adjust the pixel value q i of the interior edge 

pixel to be the predictive adjustment value q ' thereof (i.e. 
q ' = q - 0.5kA ). 

[0047] The above-mentioned noticeable difference threshold Al 
is defined according to Weber's Law. As Weber's Law de- 
scribes, the ratio of the increment threshold to the back- 
ground intensity is a constant k, i.e. the Weber Fraction k. 
In the present embodiment, the average luminance of the 
block P can be defined as I and the average luminance of 
the block Q can be defined as I . According to Weber's 

Law, the ratio of the JND Al that the human eye can 

p 

hardly distinguish to the background luminance I is equal 

to the constant k. Similarly, the ratio of the JND Al that 

q 

the human eye can hardly distinguish to the background 

luminance I is equal to the constant k. As illustrated by 
q 



the parameter list shown in Fig. 3, the noticeable differ- 
ence threshold Al utilized in the present invention method 

is the average (Al + Al )/2 of the JNDs Al and Al of the 

p q p q 

two blocks. That is, the noticeable difference threshold Al 

can be derived as the following: 

[0048] Al = (Al + Al )/2 = (kl + kl )/2 

p q P q 

[0049] As mentioned, the present invention method can be ap- 
plied to the luminance pixel values p and q . In addition, 

i i 

the present invention method can also be applied to the 
chromatic pixel values p and q . When the pixel values p 

i i i 

and q processed by the present invention method are 

i 

chromatic pixel values p. and q., the average chromatic 

pixel value of the block P can be defined as I and the av- 

p 

erage chromatic pixel value of the block Q can be defined 

as I . Similarly, the noticeable difference threshold Al can 

q 

be derived as the following: 

[0050] Al = (Al + Al )/2 = (kl + kl )/2 

p q p q 

[0051] As mentioned in step 216p, the adjustment amount 0.5kA 

of the pixel value p i of the interior edge pixel is one half 

of the adjustment amount kA Q of the pixel value p Q of the 

adjusted boundary edge pixel. In addition, as mentioned 

in step 216q, the adjustment amount -0.5kA of the pixel 



value q i of the interior edge pixel is one half of the ad- 
justment amount -kA of the pixel value q of the ad- 
justed boundary edge pixel. Please note, the parameter 
list shown in Fig. 3 illustrates that the recognizable dis- 
continuity threshold T(AQ, Al) is defined as the linear 
combination (aAQ + pAI) of the noticeable difference 
threshold Al and the difference AQ between the quantiza- 
tion parameters of the two blocks P and Q. Wherein, the 
simplest parameter set a = 3 =1 can be applied to the 
present embodiment, although this is not a limitation of 
the present invention. In another embodiment of the 
present invention, the recognizable discontinuity thresh- 
old T(AQ, Al) can be a higher order polynomial of (AQ, Al) 
or other kinds of functions of (AQ, Al) as long as the fol- 
lowing conditions are satisfied: firstly, when the difference 
AQ between two quantization parameters of the two 
blocks P and Q increases or the noticeable difference 
threshold Al increases, the recognizable discontinuity 
threshold T(AQ, Al) increases correspondingly; and sec- 
ondly, when the difference AQ decreases or the noticeable 
difference threshold Al decreases, the recognizable dis- 
continuity threshold T(AQ, Al) decreases correspondingly. 
Therefore, the present invention method further includes: 



when the difference AQ between two quantization param- 
eters of the two blocks P and Q increases or the noticeable 
difference threshold Al increases, increasing the recogniz- 
able discontinuity threshold T(AQ, Al); and when the dif- 
ference AQ decreases or the noticeable difference thresh- 
old Al decreases, decreasing the recognizable discontinu- 
ity threshold T(AQ, Al). 

[0052] please refer to Figs. 2, 4, and 8. Fig. 8 is a lookup table of 
the boundary strength (BS) used in the inter filtering pro- 
cess shown in Fig. 4, wherein the BS, which is defined in 
the JVT (H.264) specification, is well known in the art. As 
illustrated in Fig. 2, when the frame needing to be pro- 
cessed is an inter frame, step 201b will be executed. First, 
the present invention method checks if the BS of the 
frame needing to be processed according to the lookup 
table shown in Fig. 8 is zero. If the BS is zero, execute step 
201b according to the detailed steps shown in Fig. 4; else, 
the frame needing to be processed will not be renewed. 
As shown in Fig. 4, step 201b of the video processing 
method is described in detail as follows. 

[0053] step 202:Store the pixel values p and q (i = 0, 1, and 2) 

i i 

corresponding to the two blocks P and Q. 
[0054] step 206':Compare the pixel values p Q and q Q of the two 



boundary edge pixels adjacent to the boundary 401 be- 
tween the two blocks P and Q according to a threshold T 
to determine if the pixel values p and q of the two 
boundary edge pixels should be adjusted. If the difference 

Ip - q I between the pixel values p and q of the two 

o o o o 

boundary edge pixels is less than the threshold T, pro- 
ceed to step 208'; else, enter the Early Termination state 
290 to save time for further processing of other pixel val- 
ues. Wherein the threshold T of this step is defined as the 
parameter list shown in Fig. 4. 
[0055] step 208':Compare the pixel value p Q or q Q corresponding 
to one pixel out of the two boundary edge pixels with the 
pixel value p i or q i corresponding to the interior edge 
pixel adjacent to the one pixel according to an adjustment 
threshold A/2 to determine if the pixel values p and q 
of the two boundary edge pixels should be adjusted. If ei- 
ther a difference lp i ~ p Q l between the pixel values p i and 

p of the block P is less than the adjustment threshold A/ 
K o J o 

2 or a difference Iq^ q Q l between the pixel values q i and 

q of the block Q is less than the adjustment threshold A/ 
M o J o 

2, proceed to step 210'; else, enter the Early Termination 
state 290 to save time for further processing of other 
pixel values. Wherein the parameter A/2 is defined as the 



parameter list shown in Fig. 4 and therefore, the definition 
of the adjustment threshold A/2 of this step is changed 
accordingly. 

[0056] step 210':Adjust the pixel values p Q and q Q of the two 

boundary edge pixels to decrease the difference lp Q - q Q l 
between the pixel values p Q and q Q of the two boundary 
edge pixels. Wherein the difference lp Q - q Q l is a lumi- 
nance difference or a chromatic difference. The adjust- 
ment results of this step are listed as follows: 

[0057] p ' = p + kA 

[0058] q ' = q - kA 

[0059] wherein the parameter A/2 is defined as the parameter 
list shown in Fig. 4 and therefore, the adjustment results 
of this step are changed accordingly. 

[0060] | n this embodiment, when an average of the quantization 
parameters of the two blocks P and Q is less than sixteen, 
the blocking artifacts of the boundary 401 between the 
two blocks P and Q will not be processed so as to save 
time for further processing of the blocking artifacts of 
other boundaries of the video picture. 

[0061] please refer to Figs. 9-11. Fig. 9 is a block diagram of a 

perceptual loop filter 600 according to the present inven- 



tion. Figs. 10 and 11 respectively illustrate video process- 
ing systems 700 and 800 utilizing the perceptual loop fil- 
ter 600 shown in Fig. 9. While providing the above- 
mentioned method, the present invention correspondingly 
provides a loop filter 600 of a video processing system for 
processing the blocking artifacts between the two blocks P 
and Q within the video picture, wherein the video pro- 
cessing system can be a video encoder 700 or a video de- 
coder 800. As the above-mentioned method utilizes the 
recognizable discontinuity threshold T(AQ, Al) and the 
noticeable difference threshold Al related to whether the 
human eye can distinguish the blocking artifacts or not, 
the loop filter 600 is referred to as the Perceptual Loop 
Filter (PLF) 600. The loop filter 600 includes: a storage 
unit 610 for storing the pixel values p. and q. correspond- 
ing to the two blocks P and Q; and a comparison unit 620 
electrically connected to the storage unit 610 for compar- 
ing the two pixel values p Q and q Q of the two boundary 
edge pixels adjacent to the boundary 401 between the 
two blocks P and Q according to the noticeable difference 
threshold Al to determine if the pixel values p and q of 
the two boundary edge pixels should be adjusted. If the 
difference Ip - q I between the pixel values p and q of 

*0 0 0 0 



the two boundary edge pixels is less than the noticeable 
difference threshold Al, the comparison unit 620, as de- 
scribed in step 204, enters the Early Termination state 
290 to save time for further processing of other pixel val- 
ues; else, as described in step 206, the comparison unit 
620 compares the pixel values p Q and q Q of the two 
boundary edge pixels adjacent to the boundary 401 be- 
tween the two blocks P and Q according to the recogniz- 
able discontinuity threshold T(AQ, Al) to determine if the 
pixel values p Q and q Q of the two boundary edge pixels 
should be adjusted. If the difference Ip - q I between the 
pixel values p Q and q Q of the two boundary edge pixels is 
less than the recognizable discontinuity threshold T(AQ, 
Al), the comparison unit 620 further performs the com- 
parison as described in 208; else, the comparison unit 
620 enters the Early Termination status 290 to save time 
for further processing of other pixel values. As men- 
tioned, the pixel values p Q and q Q can be either the lumi- 
nance pixel values p Q and q Q or the chromatic pixel values 
p and q , and accordingly, the difference I p - q I can be 

*0 0 0 0 

either the luminance difference or the chromatic differ- 
ence. 

[0062] The loop filter 600 further includes an arithmetic unit 630 



electrically connected to the comparison unit 620 and the 
storage unit 610 for adjusting the pixel values p. and q. of 
the two boundary edge pixels. As described in step 208, 
the comparison unit 620 further compares the pixel val- 
ues p Q and q Q (corresponding to one pixel out of the two 
boundary edge pixels) with the pixel values p i and q i 
(corresponding to the interior edge pixel adjacent to the 
one pixel), respectively, according to an adjustment 
threshold A/2 to determine if the pixel values p and q 
of the two boundary edge pixels should be adjusted. If ei- 
ther the difference lp i ~ p I between the pixel values p i 
and p Q of the block P is less than the adjustment thresh- 
old A/2 or the difference Iq - q I between the pixel val- 
ues q i and q Q of the block Q is less than the adjustment 
threshold A/2, the comparison unit 620 determines that 
the pixel values p Q and q Q of the two boundary edge pix- 
els should be adjusted as described in step 210 using the 
arithmetic unit 630 to decrease the difference Ip - q I 
between the pixel values p Q and q Q . The comparison unit 
620 may further execute steps 212p and 214p to deter- 
mine if the pixel value p^^ of the interior edge pixel should 
be adjusted to be the predictive adjustment value p ' 
thereof (i.e. p ' = p i + 0.5kA Q ) as described in step 216p 



using the arithmetic unit 630. As mentioned above, the 
adjustment amount 0.5kA Q of the pixel value p i of the in- 
terior edge pixel is one half of the adjustment amount kA Q 
of the pixel value p Q of the adjusted boundary edge pixel 
mentioned in step 210. Similarly, the comparison unit 620 
may further execute steps 212q and 214q to determine if 
the pixel value q i of the interior edge pixel should be ad- 
justed to be the predictive adjustment value q ' thereof 
(i.e. q ' = q i - 0.5kA Q ) as described in step 216q using 
the arithmetic unit 630. Again, as mentioned above, the 
adjustment amount -0.5kA Q of the pixel value q i of the 
interior edge pixel is one half of the adjustment amount - 
kA Q of the pixel value q Q of the adjusted boundary edge 
pixel mentioned in step 210. 
[0063] | n this embodiment, when the difference AQ between two 
quantization parameters of the two blocks P and Q in- 
creases or the noticeable difference threshold Al in- 
creases, the comparison unit 620 increases the recogniz- 
able discontinuity threshold T(AQ, Al). In addition, when 
the difference AQ decreases or the noticeable difference 
threshold Al decreases, the comparison unit 620 de- 
creases the recognizable discontinuity threshold T(AQ, 
Al). 



[0064] a s j n the above-mentioned method, the execution of 

steps 206', 208', and 210' by the components according 
to this embodiment is similar to the execution of steps 
206, 208, and 210, respectively, with the above- 
mentioned exception of the choices of the threshold T 
and the parameter A q . Therefore, the descriptions of the 
execution of steps 206', 208', and 210' will not be re- 
peated. 

[0065] Normally, in a quantization operation of video processing, 
as the quantization parameters of all blocks within an im- 
age increase, the quality of the image becomes lower. 
Conversely, as the quantization parameters decrease, the 
quality of the image becomes higher. The quantization 
parameter range corresponding to better image quality is 
around twenty-two and below. With the range of the 
quantization parameters being around twenty-two and 
below, the present invention method and apparatus pro- 
vide equivalent image quality with the loop filters comply- 
ing with the H.264 specification in the art. 

[0066] it is an advantage of the present invention that the 

present invention method and device process the blocking 
artifacts of the video picture by loop filtering so that the 
present invention method and device have better process- 



ing efficiency in contrast to post filtering methods and 
devices. 

[0067] | t j S another advantage of the present invention that the 
present invention method and device use perceptual 
thresholds to determine if the pixel values of the two 
boundary edge pixels should be adjusted so that fast de- 
termination and ignoring of blocking artifacts that are not 
easy to identify by the human eye is available. As a result, 
the early termination of processing according to the fast 
determination enhances the processing efficiency of the 
video picture. 

[0068] it is another advantage of the present invention that the 
calculations of the present invention method and device 
are simple. Because the video picture consists of blocks 
arranged in two directions, i.e. the vertical direction and 
the horizontal direction, only pixel value(s) of up to two 
pixels located at one side of each block boundary and 
along a normal direction perpendicular to the boundary 
need to be adjusted. Therefore, the processing efficiency 
of the present invention method and device is better than 
that of the prior art methods and devices complying with 
the H.264 specification. 

[0069] Those skilled in the art will readily observe that numerous 



modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



